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ABSTRACT 

For  a  given  countable  partition  of  the  range  of  a  regenerative  sequence 
{x^  s  n  >  0},  let  Rjj  be  the  number  of  distinct  sets  in  the  partition 
visited  by  X  up  to  time  n.  We  study  convergence  issues  associated  with  the 
range  sequence  {r^  :  n  >  0}.  As  an  application,  we  generalize  a  theorem  of 
Chosid  and  Isaac  to  Karris  recurrent  Markov  chains. 


AMS  (MOS)  Subject  Classifications:  60K05,  60J27,  60F15 
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SIGNIFICANCE  AND  EXPLANATION 


-V 

Consider  a  system  which  evolves  randomly  in  time:  the  trajectory  of  such 
a  system  traces  a  path  through  space.  If  one  partitions  space  into  a  disjoint 
collection  of  subsets,  one  can  study  the  number  of  subsets  visited  by  the 
trajectory  up  to  a  certain  instant.  In  this  paper,  we  show,'that,  under 
certain  conditions,  the  number  of  subsets  never  growB  linearly  in  time, 
regardless  of  the  partition  used.  On  the  other  hand,  the  precise  order  of 
growth  (which  can  be  arbitrarily  close  to  linear  order)  does  depend  on  the  way 
in  which  space  is  partitioned.  These  results  are  obtained  for  regenerative 
random  processes.  Such  processes  describe  systems  which,  when  viewed  on  a 
certain  random  time  scale,  evolve  in  an  independent  and  identically 
distributed  fashion.  Virtually  any  ergodic  discrete-time  Markov  chain  has 
this  property. 


/ 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


ON  THE  RANGE  OF  A  REGENERATIVE  SEpUENCE 


Pater  W.  Glynn 


1.  Introduction 

Let  {Xn  >  n  >  0}  be  a  stochastic  sequence  takinq  values  in  a  measurable  space 
(E,E).  For  a  given  family  (ar  i  n  >  0)  of  E -mea surable  sets  partitioning  E,  set 

m 

Yn  '  l  k  e  V  ' 

k-0 

where  1(A)  is  1  or  0  depending  on  whether  or  not  ui  e  A.  Let  4(1,1)  »  1  and  set 
4(1, j)  -  I(V1  t  Y  y  y1+1  *  Yj,...,YJ_1  *  Yj  ) 


(1.1) 


RU,j) 


4d. k) 


k-i 

for  i  <  j.  The  process  (R(0,n)  <  n  »  0),  which  is  called  the  range  sequence  associated 
with  {Xn  i  n  >  0),  counts  ths  number  of  distinct  sets  Ak  visited  by  X  up  to  time  n. 
The  range  process  (R(Q,n)  :  n  >  0)  has  been  extensively  studied,  in  the  case  that 
(XR  :  n  >  0}  is  a  random  walk  with  stationary  increments i  see,  for  example,  Dvoretsky  and 
Erdos  (1951),  p.  35-40  of  Spitzer  (1976),  and  Jain  and  Pruitt  (1972).  Chosid  and  Isaac 
(1978,  1980)  have  considered  the  problem  when  (Xn  :  n  >  0}  is  a  recurrent  countable  state 
Harkov  chain. 

In  this  paper,  we  wish  to  study  the  range  process  in  the  case  that  (Xn  :  n  >  0)  is  a 

delayed  regenerative  sequence,  with  associated  regeneration  times  T^ ,  T2,...  (see  p.  298- 

302  of  Ginlar  (1975)  for  the  definition).  Our  starting  point  is  a  simple  decomposition 

formula  for  the  range.  In  Section  2,  we  use  this  formula  to  improve  the  main  result  of 

Chosid  and  Isaac.  Section  3  discusses  the  application  of  the  results  to  Harris  recurrent 

Markov  chains,  and  considers  a  generalisation  to  the  case  where  (A  i  n  >  0}  is  not  a 

n 

partition  of  E. 
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and  set  S(n) 


2.  Convergence  Results  for  the  Range 

Let  Rlk  -  R(Tt ,Tk-1 )  for  1  <  k,  -  R1fl+1  -  Ru» 


inf{j  >  T1  :  Y^  “  n).  flien, 

Ti 

Wt  -  l  *<Tvk) 


Vr1 


k“T. 


(2.1) 


T  - 1 
Ai+  1 


l  ♦<T1,k;)  •  l  I(Yk  -  n) 


k*T^  n«0 

«•  Ti+1 ' 


1'  l  IfYT  /-  n,...^.,/-  n,  Yk  -  n! 


n*0  k«T^  1 


-  I  KTj^  <  S(n)  <  Ti+1)  . 

n-0 

The  decomposition  formula  (2.1)  plays  an  important  role  in  our  development. 


(2.2)  Lenina,  i.)  Set  ^  -  T1+1  -  T^  Then  MWj/tj)  +  0  as  i  ♦  -. 

ii.)  If  “7  <  then  EwT  *0  as  i  ♦  ”. 

Proof.  For  i . ) ,  observe  that 


EtWj/-^)  -  y  Ed/Tj^  ,  Ti  <  S(n)  <  Ti+1) 


n«0 


(2.3) 


7  P{ S ( n )  >  T2)i"1E{l/T1  i  S(n>  <  Tj} 
n«0  i 


where  the  second  equality  follows  from  the  regenerative  property  of  X.  Since 

l  Ed/T,  ,  S(n)  <  T2>  -  EtW,/!,)  <  1  , 

n«0 

one  may  apply  bounded  convergence  to  (2.3)  to  obtain  1.).  For  ii.)#  note  that 
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1  p{rei  <  S<n1 ),..., S(nB)  <  Ti+1) 

n. # • • «n 
1  n 


(2.4) 


l  P{S(n1)  >  T2 . S(nB)  >  T2>1-1»  P{S(n.,)  <  Tj, . . .  .StnJ  <  T2> 


The  bounded  convergence  theorem  then  applies  to  (2.4)  provided  that 
l  PfStn^  <  T2,...,S(nB)  <  Tj)  -  <  • 


n . i  •  •  i  in 

1  s 


By  Minkowski's  inequality 


(E(R.  /n)“)1/B  <  l  (E(W./n>“) 


n- 1 


1/s 


i-1 

n-1 


i  1. 


1/m 


1-1 


so  the  following  corollary  is  immediate. 

(2.5)  Corollary.  If  <  -.  then  E(R1n/n)“  *0  as  n  ♦ 

The  following  lemma  shows  that  the  process  (Ri)t  i  0  <  i  <  k)  (Tq  -  0)  obeys  a  sub¬ 
additive  inequality. 

(2.6)  Lemma.  If  0  <  i  <  j  <  k,  then  Ri)t  *  R^  +  Rjk> 

Proof.  It  0  <  1  <  j  <  k,  then  (1.1)  implies  that 

V1 

Rik  •  Rij  +  £ 


Tk-1 


’  Rij  +  J_  I(YT.  "  Yt . Yl-1  *  Yl) 


I-Tj  i 


V1 


Rik  *  .L  X(Y*,  "  Yt . Yt-1  +  V 


t-Tj  J 


"  Rij  *  Rjk  * 
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The  following  theorem  now  follows  easily 


(2.7)  Theorem.  If  EW1  <  “,  then  R^/n  *  0  a.s. 


Proof .  The  regenerative  structure  of  X  implies  that  the  distribution  of 

(v,.j+i  !  1  «  *  <  j}  is  identical  to  that  of  (r^  !  1  <  X  <  j}  .  By  virtue  of  Corollary 

2.5  (m  “  1),  the  non-negativity  of  Ryj,  and  Lenina  2.6,  this  implies  that 

{r^  :  1  <  k  <  j}  satisfies  the  postulates  of  the  subadditive  ergodic  theorem  (see  Kingman 

(1973)).  Hence,  Ri„/n  *  <>  as  n  ♦  «  a.s.  But  by  Lemma  2.6, 


0  4  R0n/n  *  R01/n  *  R1n/n  *  0  a-“- 


as  n  ♦  •. 


We  wish  to  point  out  that  the  subadditive  ergodic  theorem  has  been  previously  used  to 
analyze  the  mean  range  in  a  different  setting)  see  Derriennic  (1980). 

Corollary  2.5,  Lemma  2.6,  and  the  observation  that  R(0,n)  <  RQ  +1  yield  the  next 
result. 


(2.8)  Corollary  i.)  If  EW1  <  ■»,  then  R(0,n)/n  ♦  0  a.s. 
ii.)  If  E(R01  +  w,)“  <  -,  then  E(R0n/n)“  *0  as  n  +  -. 

Recall  that  any  irreducible  recurrent  Markov  chain  (Xr  :  n  >  0}  on  { 0, 1,...)  can 

be  regarded  as  a  regenerative  sequence.  In  particular.  Corollary  2.8  shows  that  if 

T,(i)-1 

<i(i)  Je!  J  |  x  -  i)  <  - 

j-0 

(T_(i)  »  inffm  >  T  ,(i)  s  X  ■  i} ,  Tn(i)  •  0)  for  some  i,  then  R(0,n)/n  ♦  0  a.s.  This 
is  Theorem  1  of  (1).  Note  that  if  (Xn  :  n  >  0}  is  positive  recurrent,  then  a(i)  < 
E{Tj(i)  |  X(0)  ■  i}  <  m,  so  that  the  mean  range  then  automatically  converges  to  zero 
a.s.  Our  results  are  somewhat  stronger  than  those  of  [1]  in  the  null  recurrent  case. 
Theorem  2.7  proves  that  R^/n  *  0  a.s.,  whereas  [1)  only  proves  that  R0n/n  is  a.s. 
bounded  under  the  hypothesis  EW.,  <  « .  In  the  same  spirit.  Corollary  2.8  ii.)  and  Lemma 
2.2  i.)  are  more  complete  than  those  of  [ 1 ] . 


A  natural  question.  In  the  context  of  the  Markov  chains  discussed  above,  is  whether 


finiteness  of  a(i)  is  a  solidarity  property)  in  other  words,  if  a(i)  is  finite  for 

one  i,  need  a(i)  be  finite  for  all  i.  Of  course,  if  R(0,n)/n  ♦  0  a.s.  were  to  imply 

that  «(i)  <  • ,  we  would  be  done.  However,  as  pointed  out  in  [2],  a  symmetric  nearest 
neighbor  random  walk  on  the  integers  obeys  R(0,n)/n  ♦  0  a.s.,  and  yet  ot(i)  --  for 
all  i. 

Let  I^('),  P j ( • )  denote  expectation  and  probability  respectively,  conditional  on 

*0  “  J-  Let 

V(i,j)  -  inf {n  >  1  :  Tn_ t  ( j >  <  T^i)  <  {  J ) }  . 

(2.9)  Lemma.  Let  X  be  an  irreducible  recurrent  Markov  chain,  then,  for  any  i  and  j, 

o(j)  <  •  if  and  only  if  Bj  R< 0,Tv(i , j) *3)  “  D  <  "• 

Proof.  By  Lemma  2.6, 

V(i,j) 

w°.TV(i,J)(j)  -D<  jli  wvrV’i 

m 

(2.10)  -  l  WVi'Vl’KV'1'!)  >  k) 

k-1 

m 

+  T  R(Tfc_1,Tk-1)I(V(l,j)  -  k)  . 
k-1  * 

Taking  expectations  in  (2.10)  and  using  the  regenerative  property  yields 


<  l  P.lT^i)  >  T1(J)}k_1E  {WO.T^D  -  1)1  T1  (1)  >  T,  ( j )} 


k-1 


♦  r  RjfT^i)  >  T,(  j)}k'1BJ{R(0,T1(j)  -  1)1  T^i)  <  T, 


(j» 


-  Otjj/PjtT^i)  <  T,(j)> 

which  proves  one  implication.  For  the  other,  note  that  T^(j)  <  Ty^  ^(j). 


(2.11)  Theorem.  Let  X  he  an  irreducible  recurrent  Markov  chain.  Then,  if  a(i)  <  • 


for  one  1,  a(i)  is  finite  for  all  i. 

Proof.  By  Lemma  2.9,  we  will  he  done  if  we  prove  that 


(2.12)  EjR(0'TV(i,j)(3>  ‘  ’>  "  EiR<0'Tv(j,i)(1>  "  1J  ' 

By  the  same  reasoning  which  produced  (2.1), 


(2.13) 
where  S(n) 


R,0'Tv(i.j)(1>  -  m  J.0  I(i(n>  <  Tv<i,j)(J)>  * 

inf(k  >0  :  Y^  “  n}  .  But  by  the  strong  Markov  property  applied  at  T1(i), 

PjfSln)  <  Tv(1 #j)(J>> 

-  P^{S(n)  <  T,(i)>  ♦  Pj { S(n)  >  T^i)}  P1{S(n)  <  T(j)l 

-  P^Sfn)  <  T^j))  +  P^Stn)  >  T,  ( j)}  P^fStn)  <  T(i)} 

»  Pj^Stn)  <  Ty(j,  i>(i>) 


Substituting  in  (2.13)  yields  the  equality  (2.12).  || 

It  should  be  mentioned  that  a  similar  argument  appears  in  Chung  (1966),  p.  84,  in 
connection  with  a  solidarity  problem  concerning  moments  of  certain  functionals. 

As  indicated  in  (1),  the  mean  range  R(0,n)/n  can  display  a  wide  range  of  different 
limit  behavior,  in  the  absence  of  the  moment  condition  EW1  <  “ . 

(2.14)  Example .  Let  be  a  sequence  of  positive  independent  identically  - 

distributed  integer-valued  random  variables.  Suppose  their  coemon  distribution  P  is  in 

the  domain  of  attraction  of  a  stable  law  with  parameter  0  <  o  <  1.  Let  Sn  - 

T1  •*•...+  xn  and  set  t(n)  -  max(k  i  Sk  <  n)  .  The  process  X,,  ■  st(n)+i  ”  n  i»  an 

irreducible  recurrent  Markov  chain  on  (0,1, 2,...}.  Letting  A  »  (n),  we  consider  the 

n 

mean  ranoe  on  the  subsequence  (s  :  n  >  1) .  It  is  easily  checked  that 

n 

R(0,S  -1)/S  “  max  t./S 

n  n  ....  x  n 

1«k<n 

so  that 

R( 0 , S  ,)/8„  — >  Z(o) 
n-i  n 

as  n  *  »,  where  Z(a)  is  a  non-degenerate  r.v.  and  »->  denotes  weak  convergence  (see 


Feller  (1971),  p.  465) 


S 


So  far,  our  study  of  convergence  has  centered  on  normalizing  R(0,n)  by  n.  In  view 
of  the  geometric  factors  in  (2.3)  and  (2.4),  it  is  natural  to  Investigate  whether 
normalizing  by  n  a(0  <  a  <  1)  is  adequate  for  ER(0,n). 

(2.15)  Example.  Let  {x^  :  n  >  0}  be  a  sequence  of  non-negative  independent  identically 
distributed  integer-valued  random  variables,  then,  X  is  regenerative  with  Tn  ■  n, 
and  EM1  <  1.  Suppose  that  n^ERIO.n)  *0  as  n  ♦  •  where  a  <  1.  Then, 

n  n 

l  E*(0,k)A  »  l  (ER(0,k)  -  ER(0,k-1))A 
k»1  k-t 


l  ER(0,k)A(k+1)  +  R(0,n)/(n+1)  -  R(0,0)  i 
k-1 


letting  n  ♦  “,  we  see  that  the  second  term  vanishes  and  the  first  is  suiMable  since  we 
are  assuming  that  ER(0,n)  »  0(n°)  for  a  <  1.  We  will  now  show  that  (2.16)  diverges  in 
general,  proving  that  ER(0,n)  »  0(n°)  is  not  valid  without  further  assumptions .  Oslng 
(2.1),  we  see  that 


(2.17) 


l  E*(0,k)A  -  ll  P(X  f  n}k  P{X  -  n}/k 

k-1  n-0  k-1 


-  £  log(P{X1  -  n})P{X1  -  n> 

n-0 


where  we  interpret  log(0)  •  0  »  0.  Choosing  the  mass  function  p{Xt  -  n}  to  be 
C/n(log  n)2  (some  constant  C)  for  n  >  2  causes  (2.17)  to  diverge. 

We  therefore  have  the  following  conclusion.  If  (Xn  i  n  >  0}  is  a  regenerative 
sequence  for  which  Er 1  <  »,  then  ER(0,n)/n  converges  to  zero  regardless  of  the 
partition  used.  On  the  other  hand,  one  needs  conditions  on  the  partition  to  ensure 
convergence  of  ER(0,n)/n°  to  zero,  for  a  <  1. 

m 

(2.18)  Proposition.  Suppose  that  £  nYp{S(n)  <  T,}  <  •  for  some  Y  >  1.  Then, 

-a  n“° 

n“°R0n  *  0  a.s.  and  n  ER1n  ♦  0,  as  n  ♦  where  a  «  1A* 
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Proof.  let  Zn  -  max{k  i  S(k)  <  Tn+1)  and  observe  that  R1n  <  zn.  But  Zn  - 
isaxfv^, . . .  ,Vn),  where  {v^  s  i  >  1}  is  the  independent  and  identically  distrih  J 
sequence  defined  by 

<2.19)  VA  -  max{k  s  T±  <  S(k)  <  Ti+1) 

Noting  that 


EVY  -  [  nYP{S(n)  <  T  t  S(m)  >  T  for  m  >  n} 

n-0  2 

(2.20) 

OO 

<  l  nYP{S(n)  <  T,)  , 

n-0 


it  follows  that  EVy  <  “  under  our  hypotheses.  Hence,  £  VY/n  converges  tc.  4  Lte 

Y 

quantity,  which  implies  that  Z  /n  ♦  0  a.s.  Thus,  n  R„  ♦  0  a. 8. 

n  On 

For  the  convergence  of  n  aER^,  we  use  the  finiteness  of  EV^  to  conclude  that 
EZY/n  *0  as  n  +  -  (see  p.  90  of  Chung  (1967)).  But 

(2.21)  0  <  (ER  /n“)Y  <  (EZ  /nV  <  EZY/n  , 

*n  n  n 

where  the  last  inequality  is  a  statement  of  the  fact  that  (E|X|r)1/r  i8  a  non-decreasing 
function  of  r  for  any  random  variable  X.  (Feller  (1971),  p.  155.)  Relation  (2.21) 
implies  our  result.  I  I 

Recalling  that  R(0,n)  <  R^j  +  R^n,  we  obtain  the  following  corollary. 

(2.22)  Corollary,  assume  that  the  conditions  of  Proposition  2.18  are  in  force.  If 
ER01  <  •,  then  n_aER(0,n)  *0  as  n  ♦  »,  for  a  >  1/y . 

To  conclude  this  section,  recall  that  if  {Xn  s  n  >  0)  is  a  delayed  regenerative 
sequence  for  which  Ft  1  <  »,  then 

1  n  1 

-  £  P{X  €  B)  ♦  »(B)  A  -f-  P{X  £  Bl  t  >  k} 


n  k-1  k 


ET, 


T,+k 


as  n  ♦  «  (see  (4],  p.  299);  the  probability  *  is  called  the  ergodic  measure  for  the 
sequence.  Note  that 

P{S(n>  <  T2}  <  £  PtX,  +k  e  A  ;  t,  >  k) 

k-0  1 

-  *  (A  JET,  . 
n  1 
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/ 


Hence ,  if  BTj  <  -, 
partition  satisfy 
of  X. 


a  sufficient  condition  for 

m 

£  nYn(An>  <  "  for  soma  y  > 
n-0 


n^ER  +  0 
In 

1/a ,  where 


is  to  require  that  the 
*  is  the  ergodic  measure 


3.  Sobs  Extensions 

The  analysis  of  Section  2  can  be  easily  extended  to  cover  the  case  in  which 

{X  i  n  >  0}  is  a  Harris  recurrent  Markov  chain  (see  Revuz  (1975),  p.  75,  for  the 
n 

definition).  For  any  initial  distribution  for  XQ,  a  probability  space  can  be  constructed 
which  supports  both  the  Markov  chain  {Xn  :  n  >  0}  and  a  sequence  {Tn  i  n  >  1}  of  random 
times,  and  which  satisfy i 

1.)  {XT  ^  i  k  >  0}  has  an  identical  distribution  for  each  n  >  1 
n 

ii.)  S(X^  i  J  <  Tb>  is  independent  of  8(X^  t  J  >  Tn+1  )  for  n  >  1; 

see  Niemi  and  Hummel in  (19S2)  for  details  of  the  construction.  The  Markov  chain  X  can 

therefore  be  analysed  as  a  stochastic  process  analog  of  a  1-dependent  sequence  of 

identically  distributed  random  variables.  To  extend  the  results  of  Section  2  to  our 

current  setting,  it  is  necessary  to  obtain  a  moment  bound  similar  to  (2.4).  Retaining  the 

notation  of  Section  2,  we  note  that  the  1-dependence  yields  the  bound 

m 

W2»+1  ■  r  *<*2b+,  <  S(n)  <  t2bi+2} 

n-0 

•  m-1 

(3.1)  <  £  n  P{Y_  ?  n, . . .  ,Y_  >*  n}*P(S(n)  <  T,} 

n-0  J-O  2j  2J+, 

m 

-  £  P{S(n)  >  T2)mP{S(n)  <  Tj)  . 

n-0 

Since  Lssm  2.6  clearly  continues  to  hold,  systematic  application  of  (3.1)  proves  that 
Theorem  2.7  and  its  Corollary  2.8  remain  valid  in  the  Harris  chain  setting.  Further 
verification,  based  also  on  (3.1),  proves  that  Proposition  2.18  also  works  for  Harris 


chains 


Our  second  extension  concerns  the  case  where  the  collection  r  *  {A  i  n  >  0}  is  not 

n 

a  partition  of  E.  For  a  given  family  r  of  seta  satisfying  U  A  »  E,  let 

Aer 

(3.2)  4(T,A)  -  card{A  n  A  :  A  e  D 

for  A  c  E.  If  r  is  a  countable  partition  of  E  and  A  ■  (X.,...,X  },  then 

♦(r,A^)  “  R(0,n)  +  1,  where  R(0,n)  is  the  range  process  associated  with  the  partition 

r.  Thus,  (3.2)  legitimately  generalizes  the  range  sequence  studied  in  Section  2.  In  the 

case  that  r  is  not  a  partition,  t(r#A  )  can  potentially  be  of  magnitude  2",  and  hence 

it  is  not  reasonable  to  expect  that  ♦(!',a  )/n  will  always  converge.  Instead,  it  is 

n 

natural  to  study  log  4(T,A  )/n. 

n 

Set  ♦lk  -  ♦<r,Alk)  for  0  <  i  <  h  where  Aik  -  {X^  . XT  }. 

i  k 

(3.3)  lezsa.  For  0  <  i  <  j  <  k,  log  $ik  <  log  4^  *  log  4^. 

Proof.  The  argument  follows  that  used  by  Steele  (197B).  Note  that  A  n  Aik  * 

(A  n  A^j)  u  (A  n  Ajk>,  so  that  there  are  fewer  sets  of  the  form  of  the  form  A  n  Aik  than 
pairs  of  sets  A  n  a^j,  A  n  Ajk.  It  follows  that  4ik  <  II 

The  following  theorem  is  an  easy  consequence. 

(3.4)  Theorem.  Let  X  be  a  delayed  regenerative  sequence  satisfying  E  log  4 12  <  •. 

Then,  (log  4ln)/n  ♦  V(T)  a.s.  as  n  ♦  •,  where  V(D  is  a  finite  constant. 

Proof .  Since  {log  4^k  s  1  <  i  <  k)  has  the  same  distribution  as  (log  k+1  : 

1  <  i  <  k).  Lemma  3.3  and  our  moment  hypothesis  allow  one  to  apply  the  subadditive  ergodic 
theorem.  As  a  consequence,  (log  4in)/n  *  V(D  a.s.  as  n  ♦  •*,  for  each  i  >  1.  Since 

the  limit  holds  for  each  i  >  t,  it  follows  that  V(D  is  a  tail  random  variable,  in  the 

sense  that  V(D  is  independent  of  8(X^  :  )  <  T^ )  for  each  i  >  1.  Hence,  a  zero-one 
law  applies  and  V(D  is  constant  a.s.  II 

(3.5)  Corollary.  Let  X  be  a  delayed  regenerative  sequence  satisfying  Et 1  <  •.  Then 

(log  *<r, A  ))/n  ♦  V(T)/Et  a.s.  as  n  ♦  •. 
n  i 

Proof.  Since  log  ♦l2  «  T1  log  2,  the  moment  hypothesis  of  Theorem  3.4  is  satisfied,  so 

(3.6)  (log  ♦  )/n  *  V(D  a.s. 

as  n  ♦  «•. 


-10- 


we  now  show  that  If  w,  c  «2.  than  ♦(T.W,)  <  ♦  (I'.Wj).  Observe  that  two  seta  n  » 
are  distinct  if  and  only  if  (A,  A  *2)  n  w  t  f,  whera  A  denotes  syaaetrlc  difference. 
Thua,  if  W1  _c  w2,  there  are  more  sets  of  the  fora  A  n  W2  than  A  n  Mj,  proving  that 
♦  (r.w,)  <  *{r,w2).  Since  Agn  =_  A,n,  it  follows  that  6^  >  f1n.  Thua,  Leans  3.3  proves 


that  log  $0n  can  be  squeezed  by  log  6^n» 

(3.7)  log  *1n  «.  log  *0n  <  log  +  log  *  ,n  • 

Let  N(m)  ”  max{k  s  <  m}  and  observe  that 


Relations  (3.7)  and  (3.8)  allows  us  to  "squeeze*  log  ♦(r,Aj)  via 

(3.9)  log  <  log  ♦<r.AB)  <  log  ^  ♦  log  ♦  • 

Dividing  through  in  (3.9)  by  N<»),  using  (3.6),  and  exploiting  the  fact  that 

N(m)/m  +  1/et1  a. a.  yields  the  desired  conclusion.  II 

To  conclude  this  section,  we  wish  to  point  out  that  the  constant  V(D/*r ^  has  been 

extensively  studied  in  a  rather  different  context.  Vapnlk  and  Chervonenkls  (1971)  showed 

that  if  {X  i  n  >  0}  is  a  sequence  of  independent  and  identically  distributed  variates, 
n 

then  the  empirical  discrepancy  function  associated  with  V,  namely 

i  n 

-  sup  I  ).  I(X,  e  A)  -  nP{x  e  A)  I 
n  Atf  i-1  1  ’ 


converges  to  zero  a.s.  if  and  only  if  V(r)/rr1  vanishes  (see  also  [13] )»  the  constant 
V ( T ) /Ft ,  is  called  the  VapnlX-Chervonenkla  entropy  associated  with  f. 
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